Likelihood-free parallel tempering
نویسندگان
چکیده
Approximate Bayesian Computational (ABC) methods, or likelihood-free methods, have appeared in the past fifteen years as useful methods to perform Bayesian analysis when the likelihood is analytically or computationally intractable. Several ABC methods have been proposed: MCMC methods have been developed by Marjoram et al. [2003] and by Bortot et al. [2007] for instance, and sequential methods have been proposed among others by Sisson et al. [2007], Beaumont et al. [2009] and Del Moral et al. [2009]. Recently, sequential ABC methods have appeared as an alternative to ABC-PMC methods [see for instance McKinley et al., 2009, Sisson et al., 2007]. In this paper a new algorithm combining population-based MCMC methods with ABC requirements is proposed, using an analogy with the parallel tempering algorithm [Geyer, 1991]. Performance is compared with existing ABC algorithms on simulations and on a real example.
منابع مشابه
Monte Carlo Methods for Rough Free Energy Landscapes: Population Annealing and Parallel Tempering
Parallel tempering and population annealing are both effective methods for simulating equilibrium systems with rough free energy landscapes. Parallel tempering, also known as replica exchange Monte Carlo, is a Markov chain Monte Carlo method while population annealing is a sequential Monte Carlo method. Both methods overcome the exponential slowing associated with high free energy barriers. The...
متن کاملOptimal estimates of free energies from multistate nonequilibrium work data.
We derive the optimal estimates of the free energies of an arbitrary number of thermodynamic states from nonequilibrium work measurements; the work data are collected from forward and reverse switching processes and obey a fluctuation theorem. The maximum likelihood formulation properly reweights all pathways contributing to a free energy difference and is directly applicable to simulations and...
متن کاملAdaptive Parallel Tempering for Stochastic Maximum Likelihood Learning of RBMs
Restricted Boltzmann Machines (RBM) have attracted a lot of attention of late, as one the principle building blocks of deep networks. Training RBMs remains problematic however, because of the intractibility of their partition function. The maximum likelihood gradient requires a very robust sampler which can accurately sample from the model despite the loss of ergodicity often incurred during le...
متن کاملTraining Restricted Boltzmann Machines with Multi-tempering: Harnessing Parallelization
Restricted Boltzmann Machines (RBM’s) are unsupervised probabilistic neural networks that can be stacked to form Deep Belief Networks. Given the recent popularity of RBM’s and the increasing availability of parallel computing architectures, it becomes interesting to investigate learning algorithms for RBM’s that benefit from parallel computations. In this paper, we look at two extensions of the...
متن کاملVortex free energy and deconfinement in center-blind discretizations of Yang-Mills theories
Maximal ’t Hooft loops are studied in SO(3) lattice gauge theory at finite temperature T . Tunneling barriers among twist sectors causing loss of ergodicity for local update algorithms are overcome through parallel tempering, enabling us to measure the vortex free energy F and to identify a deconfinement transition at some β A . The behavior of F below β crit A shows however striking difference...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Statistics and Computing
دوره 23 شماره
صفحات -
تاریخ انتشار 2013